Adaptiveness in Map-Reduce using MPI
نویسندگان
چکیده
MapReduce is an emerging programming paradigm for data parallel applications proposed by Google to simplify large-scale data processing. MapReduce implementation consists of map function that processes input key/value pairs to generate intermediate key/value pairs and reduce function that merges and converts intermediate key/value pairs into final results. The reduce function can only start processing after completion of the map function. Due to dependencies between map and reduce function, if the map function is slow for any reason, this will affect the whole running time. In this technique, the message passing interface (MPI) strategies is used to implement MapReduce which reduces the runtime and optimized data
منابع مشابه
Towards Efficient MapReduce Using MPI
MapReduce is an emerging programming paradigm for dataparallel applications. We discuss common strategies to implement a MapReduce runtime and propose an optimized implementation on top of MPI. Our implementation combines redistribution and reduce and moves them into the network. This approach especially benefits applications with a limited number of output keys in the map phase. We also show h...
متن کاملAttenuation correction in myocardial perfusion SPECT using sequential transmission - emission scanning with 99mTc [Persain]
Introduction: Nowadays, Imaging of the myocardial perfusion (MPI) using the single photon emission tomography (SPET) in the diagnosis of coronary artery disease, especially myocardial ischemia, is of great importance. In contrast to the coronary artery angiography, MPI is non-invasive, less expensive and more physiological. Unfortunately, this image is affected by the some artifacts. Thes...
متن کاملPerformance of myocardial perfusion imaging using multi-focus fan beam collimator with resolution recovery reconstruction in a comparison with conventional SPECT
Objective: IQSPECT is an advanced high-speed SPECT modality for performing myocardial perfusion imaging (MPI), which uses a multi-focus fan beam collimator with resolution recovery reconstruction. The aim of this study was to compare IQSPECT compared with conventional SPECT interms of performance based on standard clinical protocols. In addition, we examined the concordance between convention...
متن کاملNear-Optimal Placement of MPI Processes on Hierarchical NUMA Architectures
Abstract. MPI process placement can play a deterministic role concerning the application performance. This is especially true with nowadays architecture (heterogenous, multicore with different level of caches, etc.). In this paper, we will describe a novel algorithm called TreeMatch that maps processes to resources in order to reduce the communication cost of the whole application. We have impl...
متن کاملParallel computing using MPI and OpenMP on self-configured platform, UMZHPC.
Parallel computing is a topic of interest for a broad scientific community since it facilitates many time-consuming algorithms in different application domains.In this paper, we introduce a novel platform for parallel computing by using MPI and OpenMP programming languages based on set of networked PCs. UMZHPC is a free Linux-based parallel computing infrastructure that has been developed to cr...
متن کامل